ˆ The exam is closed book, closed calculator, and closed notes except your one-page crib sheet.

Transcription

1 S 88 Summer 205 Introduction to rtificial Intelligence Final ˆ You have approximately 2 hours 50 minutes. ˆ The exam is closed book, closed calculator, and closed notes except your one-page crib sheet. ˆ Mark your answers ON THE EXM ITSELF. If you are not sure of your answer you may wish to provide a brief explanation. ll short answer sections can be successfully answered in a few sentences T MOST. First name Last name SID edx username Name of person on your left Name of person on your right For staff use only: Q. Search and Probability /0 Q2. Games /8 Q3. Utilities /0 Q4. Farmland SP /8 Q5. MDP /6 Q6. ayes Nets /8 Q7. hameleon /0 Q8. Perceptron /0 Total /80

2 THIS PGE IS INTENTIONLLY LEFT LNK

3 Q. [0 pts] Search and Probability Each True/False question is worth points. Leaving a question blank is worth 0 points. nswering incorrectly is worth points. (a) onsider a graph search problem where for every action, the cost is at least ɛ, with ɛ > 0. ssume the heuristic is admissible. (i) [ pt] [true or false] Uniform-cost graph search is guaranteed to return an optimal solution. (ii) [ pt] [true or false] The path returned by uniform-cost graph search may change if we add a positive constant to every step cost. (iii) [ pt] [true or false] * graph search is guaranteed to return an optimal solution. (iv) [ pt] [true or false] * graph search is guaranteed to expand no more nodes than depth-first graph search. (v) [ pt] [true or false] If h (s) and h 2 (s) are two admissible heuristics, then their average f(s) = 2 h (s) + 2 h 2(s) must also be admissible. (b) [3 pts],,, and D are random variables with binary domains. How many entries are in the following probability tables and what is the sum of the values in each table? Write a? in the box if there is not enough information given. Table Size Sum P ( ) P (, D + b, +c) P ( + a,, D) (c) [2 pts] Write all the possible chain rule expansions of the joint probability P (a, b, c). No conditional independence assumptions are made. 3

4 Q2. [8 pts] Games For the following game tree, each player maximizes their respective utility. Let x, y respectively denote the top and bottom values in a node. Player uses the utility function U (x, y) = x. P P2 P2 P (a) oth players know that Player 2 uses the utility function U 2 (x, y) = x y. (i) [2 pts] Fill in the rectangles in the figure above with pair of values returned by each max node. (ii) [2 pts] You want to save computation time by using pruning in your game tree search. On the game tree above, put an X on branches that do not need to be explored or simply write None. ssume that branches are explored from left to right. 4

5 Figure repeated for convenience P P2 P2 P (b) Now assume Player 2 changes their utility function based on their mood. The probabilities of Player 2 s utilities and mood are described in the following table. Let M, U respectively denote the mood and utility function of Player 2. P (M = happy) a P (M = mad) b M = happy M = mad P (U 2 (x, y) = x M) c f P (U 2 (x, y) = x y M) d g P (U 2 (x, y) = x 2 + y 2 M) e h (i) [4 pts] alculate the maximum expected utility of the game for Player in terms of the values in the game tree and the tables. It may be useful to record and label your intermediate calculations. You may write your answer in terms of a max function. 5

6 Q3. [0 pts] Utilities Davis is on his way to a final exam planning meeting. He is already running late (the meeting is starting now) and he s trying to determine whether he should wait for the bus or just walk. It takes 20 minutes to get to ory Hall by walking, and only 5 minutes to get to there by bus. The bus will either come in 0, 20, or 30 minutes, each with probability /3. (a) [3 pts] Davis hates being late; his utility for being late as a function of t, the number of minutes late he is, is { 0 : t 0 U D (t) = 2 t/5 : t > 0 What is the expected utility of each action? Should he wait for the bus or walk? (b) [3 pts] Pat is running late too. However, Pat reasons that once he s late, it doesn t matter how late he is. Therefore, his utility function is { 0 : t 0 U P (t) = 0 : t > 0 Moreover, Pat prefers riding the bus because it is more comfortable, so riding the bus incurs a utility bonus of 5. If Pat is deciding whether to take the bus or walk when the meeting is just starting, what are his expected utilities for each action? Should he take the bus or walk? (c) [2 pts] Give an example of a decreasing utility function in terms of time such that it will favor decisions that always minimize expected time to get to the meeting. (d) [2 pts] Give an example of a decreasing utility function in terms of time such that it will be risk-seeking; that is, a lottery with expected time of arrival t will be preferred to a guarantee of arrival time t. 6

7 Q4. [8 pts] Farmland SP The animals in Farmland aren t getting along and the farmers have to assign them to different pens. To avoid fighting, animals of the same type cannot be in connected pens. Fortunately, the Farmland pens are connected in a tree structure. (a) [2 pts] onsider the following constraint diagram that shows six pens with lines indicating connected pens. The remaining domains for each pen are listed below each node. ull Goat Goat ull Duck Goat ull Duck ull Duck Goat Duck Goat fter assigning a bull to pen 5, enforce arc consistency on this SP considering only the directed arcs shown in the figure. What are the remaining values for each pen? Pen Values 5 ull 6 (b) [2 pts] What is the computational complexity of solving general tree structured SPs with n nodes and d values in the domain? Give an answer of the form O( ). (c) This True/False question is worth points. Leaving a question blank is worth 0 points. nswering incorrectly is worth points. (i) [ pt] [true or false] If root to leaf arcs are consistent on a general tree structured SP, assigning values to nodes from root to leaves will not back-track if a solution exists. (d) [3 pts] Given 3 animal types, what is the most number of pens a tree structure could have, such that the computational complexity to solve the tree SP is no greater than the computational complexity to solve a fully connected SP with 0 pens? 7

8 Q5. [6 pts] MDP Pacman is using MDPs to maximize his expected utility. In each environment: ˆ Pacman has the standard actions {North, East, South, West} unless blocked by an outer wall ˆ There is a reward of point when eating the dot (for example, in the grid below, R(, South, F ) = ) ˆ The game ends when the dot is eaten (a) onsider a the following grid where there is a single food pellet in the bottom right corner (F ). The discount factor is 0.5. There is no living reward. The states are simply the grid locations. D E F (i) [2 pts] What is the optimal policy for each state? State π(state) E D D E (ii) [2 pts] What is the optimal value for the state of being in the upper left corner ()? Reminder: the discount factor is 0.5. V () = (iii) [2 pts] Using value iteration with the value of all states equal to zero at k=0, for which iteration k will V k () = V ()? k = 8

9 (b) onsider a new Pacman level D thate begins F with cherries in locations D and F. Landing on a grid position with cherries is worth 5 points and then the cherries at that position disappear. There is still one dot, worth point. The game still only ends when the dot is eaten. D D E F E (i) [2 pts] With no discount (γ = ) and a living reward of -, what is the optimal policy for the states in this level s state space? F (ii) [2 pts] With no discount (γ = ), what is the range of living reward values such that Pacman eats exactly one cherry when starting at position? (c) Quick reinforcement learning questions [PLESE WRITE LERLY]: (i) [ pt] What is the difference between value-iteration and TD-learning? (ii) [ pt] What is the difference between TD-learning and Q-learning? (iii) [ pt] What is the purpose of using a learning rate (α) during Q-learning? (iv) [ pt] In value iteration, we store the value of each state. What do we store during approximate Q-learning? (v) [2 pts] Give one advantage and one disadvantage of using approximate Q-learning rather than standard Q-learning. 9

10 Q6. [8 pts] ayes Nets (a) For the following graphs, explicitly state the minimum size set of edges that must be removed such that the corresponding independence relations are guaranteed to be true. Marked the removed edges with an X on the graphs. (i) [2 pts] D F E (ii) [2 pts] D E F (b) You re performing variable elimination over a ayes Net with variables,,, D, E. So far, you ve finished joining over (but not summing out), when you realize you ve lost the original ayes Net! Your current factors are f(), f(), f(, D), f(,,, D, E). Note: these are factors, NOT joint distributions. You don t know which variables are conditioned or unconditioned. (i) [2 pts] What s the smallest number of edges that could have been in the original ayes Net? Draw out one such ayes Net below. Number of edges = D E (ii) [2 pts] What s the largest number of edges that could have been in the original ayes Net? Draw out one such ayes Net below. Number of edges = D E 0

11 Q7. [0 pts] hameleon team of scientists from erkeley discover a rare species of chameleons. Each one can change its color to be blue or gold, once a day. The probability of colors on a certain day are determined solely by its color on the previous day. The team spends 5 days observing 0 chameleons changing color from day to day. chameleons color transitions are below. The recorded counts for the # of t+ t t = 0 t = t = 2 t = 3 # of t+ = gold t = gold # of t+ = blue t = gold # of t+ = gold t = blue # of t+ = blue t = blue (a) [3 pts] They suspect that this phenomenon obeys the stationarity assumption that is, the transition probabilites are actually the same between all the days. Estimate the transition probabilites P ( t+ t ) from the above simulation. P ( t+ = gold t = gold) P ( t+ = blue t = gold) P ( t+ = gold t = blue) P ( t+ = blue t = blue) P ( t+ t ) (b) [2 pts] Further scientific tests determine that these chameleons are, in fact, immortal. s a result, they want to determine the distribution of a chameleon s colors over an infinite amount of time. Given the estimated transition probabilities, what is the steady state distribution for P ( )? P ( = gold) P ( = blue) P ( )

12 The chameleons, realizing that these tests are being performed, decide to hide. The scientists can no longer observe them directly, but they can observe the bugs that one particular chameleon likes to eat. They know that the chameleon s color influences the probability that it will eat some fraction of a nest. The scientists will observe the size of the nests twice per day: once in the morning, before the chameleon eats, and once in the evening, after the chameleon eats. Every day, the chameleon moves on to a new nest. (c) [ pt] Draw a DN using the variables t, t+, M t, M t+, E t, and E t+. refers to the color of the chameleon, M is the size of a nest in the morning, and E is the size of that nest in the evening. When the chameleon is blue, it eats half of the bugs in the chosen nest with probability /2, one-third of the bugs with probability /4, and two-thirds of the bugs with probability /4. When the chameleon is gold, it eats one-third, half, or two-thirds of the bugs, each with probability /3. (d) [4 pts] You would like to use particle filtering to guess the chameleon s color based on the observations of M and E. You observe the following population sizes: M = 24, E = 2, M 2 = 36, and E 2 = 24. Fill in the following tables with the weights you would assign to particles in each state at each time step. State at t = Weight State at t = 2 Weight lue lue Gold Gold 2

13 Q8. [0 pts] Perceptron We would like to use a perceptron to train a classifier for datasets with 2 features per point and labels + or -. onsider the following labeled training data: Features Label (x, x 2 ) y (-,2) (3,-) - (,2) - (3,) (a) [2 pts] Our two perceptron weights have been initialized to w = 2 and w 2 = 2. fter processing the first point with the perceptron algorithm, what will be the updated values for these weights? (b) [2 pts] fter how many steps will the perceptron algorithm converge? Write never if it will never converge. Note: one steps means processing one point. Points are processed in order and then repeated, until convergence. (c) Instead of the standard perceptron algorithm, we decide to treat the perceptron as a single node neural network and update the weights using gradient descent on the loss function. The loss function for one data point is Loss(y, y ) = (y y ) 2, where y is the training label for a given point and y is the output of our single node network for that point. (i) [3 pts] Given a general activation function g(z) and its derivative g (z), what is the derivative of the loss function with respect to w in terms of g, g, y, x, x 2, w, and w 2? Loss w = (ii) [2 pts] For this question, the specific activation function that we will use is: g(z) = if z 0 and = if z < 0 Given the following gradient descent equation to update the weights given a single data point. With initial weights of w = 2 and w 2 = 2, what are the updated weights after processing the first point? Gradient descent update equation: w i = w i α Loss w (iii) [ pt] What is the most critical problem with this gradient descent training process with that activation function? 3

14 THIS PGE IS INTENTIONLLY LEFT LNK